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Abstract 

In this note, we consider an optimal control problem associated to a differential 
equation driven by a Holder continuous function g of index /? > 1/2. We split 
our study in two cases. If the coefficient of dgt does not depend on the control 
process, we prove an existence theorem for a slightly generalized control prob- 
lem, that is we obtain a literal extension of the corresponding deterministic 
situation. If the coefficient of dgt depends on the control process, we also prove 
an existence theorem but we are here obliged to restrict the set of controls to 
sufficiently regular functions. 
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1 Introduction 

In recent years, several authors have been interested in control problems involving 
a stochastic process driven by a fractional Brownian motion (fBm in short). This 
kind of situation may indeed be natural when one wishes to modelized a problem in 
which long distance memory effects may occur. However, contrary to the situation 
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of processes driven by ordinary Brownian motion, fBm lacks many strong stochastic 
properties (in particular, martingales properties) . Although attempts have been made 
to build a stochastic calculus for fBm some twenty years ago (see [T] for a nice survey), 
the developed techniques remain until today not so easy to use. 

In order to deal with the situation of control for processes driven with fBm, it 
was up to now necessary to limit oneself to special situations. Two directions have 
been mainly considered in recent literature: 

1. A series of paper used a stochastic calculus based on Wick integrals and devel- 
oped in 0; see in particular 9j for considerations about application to mathe- 
matical finance. Moreover, in a recent paper ^Oj, the special situation of a linear 
regulator driven by fBm was considered and optimal controls characterized. 

2. A completely different way has been followed in several papers of a group in 
France, but only when the considered problem is strongly linear, a situation 
permitting to the author to use a martingale representation of fBm in order to 
transform the original problem in an ordinary stochastic control problem (see 
in particular ^1] for a general exposition of the method). 

In the present paper, we also keep a stochastic control problem for a process 
driven by a fBm in the background, and we want to study existence results for optimal 
controls. Nevertheless, as the basic property we need in our approach occurs to be 
the Holder regularity of the paths of fBm, we study here the deterministic situation 
where the state under control is driven by a Holder continuous function g of index (3 

Xt=Xo+[ a(s,M„x^)c/^, + /" b{s,Us,x"'^)ds, t e [0,T], (1) 
Jo Jo 

where the control process u belongs to a set of admissible controls U. When f3 G 
(1/2, 1), it is possible to choose Young integral [TTj for integration with respect to dgt 
in (0), which simply appears to be the limit of Riemann sums. Moreover, as it was 
remarked in Tl^ , it is possible to express it in terms of fractional derivative operators 
(see Section 2 below). This appears to be very useful to allow easier computations, 
and mostly has motivated us to restrict to the case where /3 G (1/2,1) in order 
to choose the Young integral. The next step would be considering the case where 
(3 G (1/3,1/2]. In the very recent work jH], an equivalent to the expression of the 
Young integral in terms of fractional derivative operators has been proposed, using 
quadratic multiplicative functional. Thus, the strategy introduced in this paper could 
also certainly be derived for /3 G (1/3,1/2] and we propose to study this fact in a 
forthcoming paper. 
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The control problem considered in the present paper can be set in the following 

way. 

Problem: 'A cost functional J : W — > M being given, is it possible to prove , , 
the existence of m* G W realizing inf^jg^^ J(m)?' ^ ' 

As usual, the bigger U is, the more difficult it is to answer this question. A 
general methodology is to look for conditions ensuring that U be compact for a certain 
topology under which J is continuous. 

Differential equations of the type (H)) (without the control process u) have been 
intensively studied in recent years, due in particular to possible applications for fBm 
(see, e.g., [TllHllinilllllini)- Since the obtention of solutions to (H)) requires in general 
regularity on the coefficients (see Theorem |21 below) , we split our study in two cases. 

1. If the coefficient of dgt does not depend on the control process, we are able 
to extend the deterministic situation, and to prove an existence theorem for a 
slightly generalized control problem where the controls are in fact randomized : 
see Corollary [Hand PropositionlH In fact, we use the so-called 'compactification 
methods', which have been developed during the 1960 's for deterministic control 
problems (see jH], JH]); and during the 1970's for the stochastic control problem 
(see 0, H). 

2. If the coefficient of dgt does depend on the control function, the situation is 
much more intricate, and this obliges us to severely restrict the set of controls 
to sufficiently regular functions. A challenging question would be to relax this 
hypothesis, but this would require to get a reasonable notion of solution for a 
differential equation with a weaker regularity than Holderian. This seems not 
to be already available in the literature, up to our best knowledge. 

The paper is organized as follows. In section 2, we recall some now classical 
facts on fractional integrals and derivatives, which are useful for the sequel. In section 
3, we study the optimal control problem in the case where a does not depend on u. 
The case where a depends on u is considered in section 4. 

2 Fractional integrals and derivatives 

Let a,b E M., a < b. For any p > 1, we denote by = L^^a, b]) the usual Lebesgue 
spaces of functions on [a, b]. 

Let f E L} and a > 0. The left-sided and right-sided fractional Riemann- 
Liouville integrals of / of order a are defined for almost all x G (a, b) by 
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a+J \ J r n - \ T _ / t _ ^ I ^ ^ 



and ^ 

i (a) A 

respectively, where (— = e~*™ and T{a) = r°'~^e~^dr denotes the usual Euler 
function. 

If / e (resp. / e Ik-iLP)) and a G (0, 1), then for almost all x G (a, 6), 

the left-sided and right-sided Riemann-Liouville derivative of / of order a are defined 
by 

/(^) , r M^y) 

r O / 

V{l-a)\{x-aY A 
and 

respectively, where a < x < b. 

If/iG (0,1) andTe (0, oo), we note ^^([0, T]) the set of functions ^ : [0,T] ^ 
M such that 

\9{t)-g{s)\ ^ , 

sup j j < +00. 

0<s<t<T \t - S]/^ 

If there is no ambiguity, we prefer note instead of C^([0,T]). The set is a 
Banach space when it is endowed with the following norm: 

9it)-gis)\ 
o<t<r''^'" o<s<i<r |t — si'' 

We also set, for a,b e [0, T] and g G C: 



\g\oc,^, ■■= sup \g{t) \ + sup 



\g\a,b,^i = sup 



a<s<t<6 \t-s\f^ 

and 

|5'|a,6,oo = sup \g{t)\. 

a<t<b 

When a = and b = T we simply note \g\^ and \g\oo instead of \g\o^T,fj. and \g\o,T,oo 
respectively. 

Let / : M ^ M G and ^ : M ^ M G C' with A,/i G (0,1) such that 
A + /i > 1. Then, for any a, 6 G [0,T], the Young integral [Hj fdg exists and we 
can express it in terms of fractional derivatives (see PHj): for any a G (1 — /U, A), we 
have ^ ^ 

/" fdg={-ir [ D:j{x)Dlz'^gax)dx, (5) 
where gb-{x) = g{x) — g{b). 
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3 First case: when a does not depend of u 

In the sequel, we fix xq G M, /? G (1/2, 1), T G (0, oo) and g e = C^([0,T]). We 
assume moreover that a : [0, T] x M — >■ M is C^'^ with bounded derivatives and that 
b : [0, T] X — > M is bounded and global Lipschitz, uniformly in a; G M with respect 
to {t,u) G [0,T] X M. 

Theorem 1 For any measurable control u : [0,T] — > M, the integral equation 

x'^ = xl+f a{r,x'f)dgr+ [ b{r,x'f,Ur)dr, t e [0,T] (6) 
Jo Jo 

admits a unique solution G C'^([0,T]). 

Proof of Theorem [TJ 

• We first prove Theorem in the autonomous case, that is when a{t,x) = cr(x) 
and b(t,x,u) = b{x,u). In other words, we consider 

Xt=x^+ [ a{x:^)dgr+ [ 6(x:f,u,)rfr, tG[0,T] (7) 
Jo Jo 

instead of (jH)). At this level, we need a preliminary lemma: 

Lemma 1 Assume that h : [0,T] x R'' — M is such that, for any R> 0, there 
exists C/j > verifying 

^{r,g,u,y,z) G [0,T] x [-R,R] x : \h{r, g,u,y) - h{r, g,u, z)\ < CR\y - z\, 

(8) 

and that u : [0,T] R is a measurable function. Then the integral equation 

yt = yo+ h{r,gr,Ur,yr)dr, t e [0,T] (9) 
admits a unique solution y G C°([0,T]). 

Proof of Lemma We only sketch the proof, the arguments used being 
classical. 

Existence. Let us define {y"') recursively by y^{t) = y^ and 

y-+\t)=yo+ [ h{r,g{r),u{r),y''{r))dr, t e [0,T]. 
Jo 
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Since g is continuous, there exists i? > such that g{\Q,T]) C [—R,R\. Thus, 
using the hypothesis made on /i, it is classical to prove that — Z/"|oo < 
In particular, the sequence {y'^) is Cauchy and the limit ?/ is a solution to ©• 
Uniqueness. Let y and z be two solutions of ©. Then, for any t G [0,T], we 
easily have 

\y - Aoo\o,t] <cr \y - z\oo,[o,r]dr 
Jo 

and we can conclude that y = z using Gronwall's lemma. 

□ 



We now apply the Doss-Sussmann's method in order to finish the proof of 
Theorem n in the autonomous case. First, we denote by the unique solution 
to 

^{g,y)=ao (j){g, y), Vr?, y G M and </.(0, y) = y,\/ye R. (10) 
dg 

The hypothesis made on a ensures that (j) is well-defined. We also have, for 
g,yeR: 

^i9,y) = (iw( f (^'{(p{h,y))dh 
Define / : M^' M by 







f{g, u, y) = ^^tit^^f^ = ^('^(^' ^) (- r ^))^^ 

^{9,y) \ Jo 

The hypothesis made on b and a ensures that h : [0, T] x ^ M defined by 
h{r,g,u,y) = f{g,u,y) verifies (jHI). Thus, there exist a unique y solution to 
0. Using the change of variable formula, it is now immediate to prove that 
x" = 4>{gt, yt) is a solution to ((Tj). For the uniqueness, it suffices to adapt to our 
context the proof contained in page 103. 

The general case being similar with the previous case, we only sketch the proof. 
Here, we have to consider given by 

^{r,9,y) = a{r,<f){r,g,y)), y{r,g,y) G [0,T] x (11) 

with initial conditions 

0(r,O,y) = y, V(r,y)G[0,r]xM 
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instead of (fTUI) . Moreover, ?/ : [0,T] — > R is, in the case, defined as the unique 
solution to with h given by 



n[r, q,u,y) = rrr , 

^ ^ fyir,g,y) 

see also 0, page 116. Finally, the unique solution to © is given by 

< = (j){t,guyt)- 

□ 

In order to make use of a compactification method, it is necessary to enlarge 
the set of controls by considering relaxed controls. 

Definition 1 A relaxed control is a measure q over U x [0, T] such that the projection 
of q on [0,T] is the Lebesgue measure. We denote by V the set of relaxed controls. 

A relaxed control q can be decomposed with a measurable kernel: q{da, dt) = 
qt{da)dt where t \—>- qt is a measurable function from M+ to the set of probability 
measures on U. There is a natural embedding of (non-relaxed) controls in the set 
of relaxed controls: g is a non-relaxed control if at each time t, qt concentrates on a 
single point Ut. In other words, we assimilate the control {ut)te[o^T] with the relaxed 
control Sutdt where 6^ denotes the Dirac measure at x. We denote by V the set of 
non-relaxed controls. 

The main result that we shall need is the immediate following consequence of 
the vague topology. 

Proposition 1 Suppose U is a compact subset o/M". The set V of relaxed controls 
equipped with the vague topology is compact. 

From now on, we shall suppose that the set U is compact. A solution to 
equation (jHI) associated to a relaxed control q is obtained in the following extension 
of Theorem ^ 

Theorem 2 Let q E V be a relaxed control. There exists a unique solution x'^ G 
C°([0,T]) of the equation 

= ^0 + / cr{r,xl)dgr+ / / b{r,xl,a)qr{da)dr. (12) 
Jo Jo Ju 

Moreover, q^ x'^ is continuous from V to C°([0,T]). 



7 



Proof. Denote by the unique solution to (fTTj). Set 

, , /^6(r,0(r,^,y),a)g,(cia)-f (r,^,y) 

Clearly, due to the hypotheses on b and a, V(r, g, q, y, z) G [0, T] x [— i?, i?] x V x M x M, 

\hir,9,q,y) - h{r,g,q,z)\ < CR\y - z\. 

Therefore, the integral equation Q admits a unique solution y G C°([0,T]), see 
LemmaHJ Then, one may check that x1 = (pit, gt, yt) is a solution to (fT^. Uniqueness 
is obtained as before. 

Suppose now that g" is a sequence in V, converging to g G V and let be the 
solution of Q associated to h = h{r, g,q^,y) given by (fT^ . Using hypotheses on 6, 
we now prove that converges to y in C°([0,T]). Indeed, 



\yt - Vt 



< 



< 



lolHs, gs, g, Vs) - h{s, gs, g", 
/o ^(s, 5-5, g, - /o ^(s, 5-5, g", ys)ds 
^ lo Hs, gs, g", ys)ds - /J ^„ g", ?/;')c/s 



In the last expression, the first term tends to due to the vague convergence 
of q^{da)ds to qs{da)ds, and continuity and boundedness hypotheses on b. It results 
therefore from Gronwall's lemma that \y — y^\oQ tends to 0. Finally, as the solution 
x'^ (resp. x'^") of (fT^ associated to g (resp. g"") is given by Xt = 4>(t,gt,yt) (resp. 
x^ = (pit, gt, Vt)), one easily deduces that \x — x"|oo tends to 0. ^ 



Consider now a cost in integral form: for Ut a given control taking values in 



f/, we set 



J{u) 



i{r, x", Ur)dr 



where £ is a bounded continuous function on (r, x, u). The definition can be immedi- 
ately extended to the case of relaxed controls: if g is a relaxed control from V, 



J{q) 



Ju 



i{r, xl, a)qr{da)dr. 



Using the continuity property of Theorem |2l and the hypotheses on i, one obtains 
the following Proposition. 
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Proposition 2 Under the hypotheses introduced in the previous paragraph, the ap- 
plication q \—>- J{q) is continuous on V. 

The set V being compact, one immediately deduces the following existence 

result. 

Corollary 1 Under the prevailing hypotheses, there exists g* G V such that 

J(g*) = inf J(g). 

We conclude the present section by proving that one has not enlarged too 
much the control problem by considering relaxed controls. More precisely, we now 
prove that the optimal cost (i.e. the infemum of the cost functional) over relaxed and 
non-relaxed controls is the same. This result is obtained as in the deterministic case 
by means of approximation of relaxed controls by step constant relaxed controls, and 
then by non-relaxed controls via the so-called chattering lemma, a method originally 
introduced in 0. We here only sketch these two steps. 

First step : g G V is approximated by relaxed controls of the form 

N-l k 
j=0 i=l 

where = to < ti < "■" < tN = 7", oi, . . . , are elements in U, and for each 

k 
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0, . . . , N — 1, q{, . . . ,ql are non-negative real numbers such that qj = 1. This 



i=l 



is a straightforward consequence of approximation of the measurable function t ^ qt 
by a step function and of approximation of a probability measure /z on [/ by point 



measures of the form /ij^a,; ■ 



i=l 

Second step: Recall the chattering lemma (see [HI, Theorem 1) 
Proposition 3 Let ai, . . . , he in U and qi, . . . ,qk be non-negative real numbers 

k 

such that ^^^j = 1- Let f be a bounded continuous function from [s,t] x U to M. 
1=1 

Then, for e > given, there exists a measurable partition Vi, . . . , of [s,t] such that 

k k 



"'^ i=i i=i -'^i 



r, ttijdr 



< e. 
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In other words, the step-relaxed control ( X]i=i '?i^a,('^o))(ir is approximated by the 
non-relaxed control Yl!i=i ^v^{r)^aXda)dr. Therefore, for any g G V, there exists a se- 
quence of (non-relaxed) controls g" which converges to q. As, obviously, the infemum 
of J on V is smaller than the infemum on V', using the continuity of J, we obtain the 
following comparison result. 

Proposition 4 Under the hypotheses of the present section, infggv J{(l) = infqev J{(l)- 

4 Second case: when a depends of u 

As already mentioned in the introduction, the case when u enters the coefficient of 
dgt seems to be much more complicated as we do not have a reasonable way for 
integrating functions less regular than Holderian. Therefore we shall need to restrict 
very strongly our admissible controls set. 

In the sequel, we fix xq G M, /5 G (1/2,1), T G (0,oo), g e = C^([0,T]), 
a : [0, T] X ^ M G C^'^'^ with bounded derivatives and 6 : [0, T] x ^ M global 
Lipschitz continuous. 

Theorem 3 For any control u E with 1 — (3 < ^ < (3, the integral equation 

x'^ = x^+ [ a{r,x'f,Ur)dgr+ [ b{r,x'f,Ur)dr, t e [0,T] (14) 
Jo Jo 

admits a unique solution G C^. 

Proof of Theorem |^ It suffices to adapt the proof of Ruzmaikina to our 
context, i.e. to hold account of the control u. There is not new difficulties. See also 
Nualart and Rasganu [inj. 



Theorem 4 If U is a set of functions which is bounded in a certain with ji G 
(1 — /5, /3] and if J -.lA ^ M zs continuous for \ ■ \aoy for a certain fj,' E {1 — (3, fi) then 
the following control problem can be solved: 

there exists u* ElA realizing inf^jg^^ J{u). 

Proof of Theorem |2 It is a direct consequence of Lemma |21 below. 
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Lemma 2 If U is a set of functions which is bounded in a certain with ji G 
{1 — (3,(3] then the set of all couples {u, x") eUxC^ is relatively compact in x 
for any /i' G (1 - 

Proof of Lemma [2] According to Lamperti we know that U is relatively 
compact in . Lemma 01 below allows then to conclude. r-| 



Lemma 3 For any /i G (1 - (3,(3], : ^ C^' defined by T^'iu) = x"" is a 
continuous operator. 

Proof of Lemma We adapt the proof of Theorem 3.2 in Hu and Nualart [7j. 
For simplicity, we assume that cr(r, = a{x,u) and b{r,x,u) = b{x,u), the proof 
of the general case being similar. Moreover positive constants, depending only on b, 
cr, their derivatives, Xq and g, will be denoted by k, regardless of their value. Let 
(m") C be such that m" — > u. Fix s,t E [0, T] and let a G (1 — /i). We can write, 
using (0): 

rp'^ /y>^^ /j>U _|_ rfUn 

Jyf. "T I 

= jl[a{x'^.,Ur) - a{x'^",u")]dgr + f^[b{x'^,Ur) - b{x'^'^ ,u'(:.)]dr 

< jl \D'^^[a{x'::,Ur) - fT(x^,<)]| ■ \Dlz'' gt-{r)\dr + |&«> ^r) - 6«",<)M^- 

Using (jlj, it is easy, on one hand, to show that 

\D]z-gt-{r)\<k\g\p\t-r\-^^~\ 

On the other hand, we have, using Q: 

|D°+[a(x:f,n,)-a«",<)]| 
< l^'loo (k" - x^-\s,t,oo + \u- (r - s)-" 

+ |o-'|oo (k" - +\u- u%^t,i,) {r - s)^-" 

+ W"\oo - x«"|,,t,oo + |w - w1s,t,oo) (|a;""|s,t,M + KU^.) (r - s)^-". 
We deduce that 



+ -x""|,,t,oo + |m -M"i,,t,oo)(k""|,,t,^ + KU^.)it - s)^] 

and, by rearranging: 

< - kit - sf)-^ Hx" - x^-\s,t,oo + |'« - M"kt,oo + \u- u%,tAi - sf (15) 
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Then, if we set A = t — s: 

+ |n - u"|,,t,^A^ + - x""|,,t,oo + |« - u%,t,oo)i\x''-\s,t'^^+ \u%,t,^.)A''] . 
By rearranging, we obtain 

- x"" |,,t,oo < [1 - ^(1 - A;A^)"^ A^(l + + \uX,t,f^)^'^)] ~^ 

X (|a;« - + A;(l - A;A^)-iA^ [\u - m"|oo,m + |« - M^Uda^^-U + • 

We can finish as in ^ to obtain that |a;" — x^"\oo — ^ as n ^ oo. Using finally psp . 
we obtain that |a;" — x*'"|oo,^ — >■ as n — > oo, that is x"" — ^> x" in C^. In other words, 
T'^ is a continuous operator from to himself. |--| 

An example of a cost J satisfying conditions of Theorem |3] is 

J{u)= I i{r,x^,Ur)dr 
Jo 

with £ : [0, T] X M2 ^ M verifying 

V(r, X, y, u, v) G [0, T] x R^, |£(r, x, u) — i{r, y,v)\ < est (|x — ?/| + |-u — f |) . 
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